| |
|
|
|
Robots.txt is a visual editor for Robot Exclusion Files and a log analyzer software. It allows a user to quickly and easily create the robots.txt files required to instruct search engine spiders, which parts of a Web site are not to be indexed and made searchable by the general Web public and then to identify spiders, which do not keep to those instructions.
The program provides the user a way to log onto his FTP or local network server and then select the documents and directories which are not to be made searchable.
By means of this program you will be able to visually generate industry standard robots.txt files; identify malicious and unwanted spiders and ban them from your site; direct search engine crawlers to the appropriate pages for multilingual sites; use robots.txt files for doorway page management; keep spiders out of sensitive and private areas of your Web site; upload the correctly formatted robots.txt files directly to your FTP server not switching from Robots.txt Editor; track spider visits; create spider visits reports in HTML, Microsoft Excel CSV and XML formats and more. Free program`s updates and upgrades unrestricted in time; unlimited number of Web sites to work with |
|
|
|
NEWS
So far, nothing for that!
RECOMMENDED DOWNLOADS IN THIS CATEGORY
|
|
|
|
| » Team Remote ASP Debugger 6.06
|
| Team Remote ASP Debugger enables your team to easily edit and debug Active Server Pages (ASP code errors) remotely and locally. JavaScript debugging and VBScript debugging is fully supported for simple and complex local, remote and team remote debugging s ... |
|
| Spline Technologies | 577KB | Win 2000/XP | $50 | Downloads: 1508 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Art HTML Listing 3.26
|
| Art HTML Listing creates filtered, sorted, fully customizable directory listings, indexes, menus, maps and trees in HTML, DHTML, XML, text and CSV formats, as well as the list of MP3 and image files. Supports HTML titles, icons, media types, MP3 ID3 tags ... |
|
| ZZEE | 2244KB | Win 98/ME/2000/XP | $29.95 | Downloads: 1457 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Link Checker Pro 3.3.11
|
| Link Checker Pro is the leading solution for website analysis and the detection of broken and other problem links. Link Checker Pro combines powerful features and an easy to use interface and is robust enough to deal with corporate websites containing 100 ... |
|
| Link Checker Pro | 5056KB | Win 95/98/ME/NT/2000 | $75.00 | Downloads: 1506 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Crossword 7.50310-2110
|
| Like Scrabble? Wish you could play with family and friends who are miles away? Now it`s possible with the online Crossword script. Great, realistic, Scrabble-style action Letter bag, personal tray, password protected Automatic turn sequencing and email up ... |
|
| CrookedBush.com Inc. | 83.54KB | Linux | $24.96 | Downloads: 1398 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » MetaDataMiner Catalogue PRO 4.2.12
|
| Extract metadata from MS Office, PDF, HTML, Adobe files, IPTC info from jpeg and tif images into XML, CSV, Word files or HTML pages without programming. Set file properties via mass update function for MS Office and NTFS Windows 2000 files. You will ea ... |
|
| Soft Experience | 2995KB | Win 95/98/ME/NT/2000/XP | $175.00 | Downloads: 1331 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » AscToHTM 5.0
|
| AscToHTM is a powerful and highly configurable utility that converts text files into HTML pages. The software uses advanced text-recognition algorithms to detect the headings, bullets, indentation levels, emphasized text, tables and ASCII art in the origi ... |
|
| JafSoft Limited | 1891KB | Win 95/98/ME/NT/2000/XP | $30.00 | Downloads: 1618 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » SWC Repository 1.3
|
| SWC Repository is a tool for advanced usersof Macromedia Flash MX 2004 Professional,allow you to: -= With ease manage huge collections of SWC files(SWC Component package). -= View and edit SWC file content. -= Share your components with friends and colle ... |
|
| ShurikSoft | 1023KB | Win ME/NT/2000/XP | $20 | Downloads: 1530 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » www-Sharp 1.40
|
| www-Sharp is program for wysiwyg web-design and creating server-side and client-side HTML applications. It includes powerfull HTML editor, XML editor, tools for creating HTML help applications, .Net IDE, viewers for Windows Management Instrumentation (WMI ... |
|
| Viatcheslav V. Vassiliev | 8636KB | Win 98/ME/2000/XP | $125 | Downloads: 1411 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » SSEditor 0.9.8.402
|
| SSEditor features include: Edit any type of text file, include UNICODE text file. Support multi-file editing, edit many files at the same time in one SSEditor window. Support Drag and Drop files from the Explorer. Embedded File Explorer, you can browse a ... |
|
| Skyweb Software | 1372KB | Win 98/ME/NT/2000/XP | $29.95 | Downloads: 1391 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Techvision Color Picker 1.2
|
| Techvision Color Picker can pick colors from anywhere on your screen with a single mouse click or a key press. After picking it shows you the color in a variety of ways, including RGB and HSL pairs, Delphi, C++ or HTML constants. With a single click you c ... |
|
| Technical Vision Software Limited | 291KB | Win 95/98/ME/NT/2000/XP | $14.95 | Downloads: 1405 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| » XDenSer HTTP Server Component Pack 1.1b3
|
| With XDenSer HTTP Server Components Pack you can easily create a standalone HTTP server w/o any HTML coding. Just put TxdsHTTPServer component and TxdsFormContentProducer on your form, create 1 HTTPAction Item and your form is turned into web form ready t ... |
|
| XDenSer Components | 701KB | Win 95/98/ME/2000/XP | $34 | Downloads: 1423 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » ApoServer 1.0
|
| Platform for e-commerce and web-development, providing implementation of component oriented technologies. Using ApoServer you can develop Web-enabled application without knowing much about ApoServer utilized technologies, and provide high product quality ... |
|
| ApoSoft | 3186KB | Win NT/2000/XP | $699 | Downloads: 1492 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » CGIMachine - ACCESS COUNTER Version 2.20
|
| [english] The CGIMachine- Access Counter is a powerful counter for your webserver. The counter can be used on all Web pages on the server without multiple copies of the application, by setting a key for each Web page that will have a counter. It includes ... |
|
| T-online.de | 0 | Win 95/NT/2000/XP/98/ME | $59 | Downloads: 1467 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » GraphicsWizard 2.0
|
| Web Graphic Wizard is the program intended for fast and easy creation professional web of a graphics. You can create buttons, labels, banners. Easily with them to operate to unite, to export to various graphics formats. You can work with libraries of styl ... |
|
| Evgesoft.com | 0 | Win 95/NT/2000/98/ME | $29.95 | Downloads: 1430 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » ASP Beautify 1.5 1.5
|
| ASPBeautify beautifies the source code of Active Server Pages and HTML Files. Features are VBScript and HTML indention, automatic clipboard and multi file beautifying. Simply copy the ASP-Sources from your editor into the clipboard, click on `Beautify ... |
|
| Paessler.com | 0 | Win 95/NT/2000/98/ME | $20 | Downloads: 1509 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Surfstats Log Analyzer 7
|
| Log file analyzer for Windows 95/98/NT. Retrieves log files from the host server, uncompresses it if required, generates, displays and prints html based web activity reports from it. Unique summary and detail reporting modes of more than 30 reports. Dynam ... |
|
| Surfstats.org | 0 | Win 95/NT/2000/XP/98/ME | $95 | Downloads: 1483 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Atrise Everyfind Personal License latest
|
| Everyfind allows you to design a website search engine script for your web site, CD, DVD or any portable documentation. This website search software does not require server side execution access and can run virtually anywhere. Key features: wildcard and b ... |
|
| Atrise.com | 0 | Win 95/NT/2000/XP/98/ME | $69.95 | Downloads: 1429 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » HTML Catalog Maker (Commercial version) 1.1
|
| My money counter helps manage income and expense. With this program you can: Enter all income and expense at a daily basis. Create analytical and rundown reports based on the transactions. Watch diachronically the course of income and expense. The ... |
|
| Xarka.com | 0 | Win 95/NT/2000/XP/98/ME | $39 | Downloads: 1445 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| |
| Asp-components.de | 0 | Win 95/NT/2000/98/ME | $33.62 | Downloads: 1551 |
| Date added: Sep 23, 2005 |
» Details |
|
|
| » Surfstats Log Analyzer Professional Edition 7
|
| SurfStats analyzes log files and creates web activity reports from it. Features include: 1. Integrated report viewer and printer; 2. Summary and detail reporting modes of more than 30 reports; 3. Dynamic DNS lookup of IP addresses; 4. Control panel for dy ... |
|
| Surfstats.org | 0 | Win 95/NT/2000/XP/98/ME | $395 | Downloads: 1365 |
| Date added: Sep 23, 2005 |
» Details |
|
|
|
|
| |
